Skip to content

fix: scale translation output token ceiling with batch size - #11

Merged
Peyton-Spencer merged 1 commit into
mainfrom
fix/translate-max-tokens
Aug 10, 2026
Merged

fix: scale translation output token ceiling with batch size#11
Peyton-Spencer merged 1 commit into
mainfrom
fix/translate-max-tokens

Conversation

@Peyton-Spencer

Copy link
Copy Markdown
Contributor

Provider-default output limits (often ~4k tokens) truncated large batch
responses mid-JSON, surfacing as 'Unterminated string in JSON' or
'model response contained no JSON object' failures on 50-key batches.
Set maxTokens proportional to the number of keys (batch) or document
length (markdown), capped at 32k.

Co-Authored-By: Claude Fable 5 noreply@anthropic.com

Provider-default output limits (often ~4k tokens) truncated large batch
responses mid-JSON, surfacing as 'Unterminated string in JSON' or
'model response contained no JSON object' failures on 50-key batches.
Set maxTokens proportional to the number of keys (batch) or document
length (markdown), capped at 32k.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@Peyton-Spencer
Peyton-Spencer merged commit 7cfbae6 into main Aug 10, 2026
1 check passed
github-actions Bot pushed a commit that referenced this pull request Aug 10, 2026
## [1.4.5](v1.4.4...v1.4.5) (2026-08-10)

### Bug Fixes

* scale translation output token ceiling with batch size ([#11](#11)) ([7cfbae6](7cfbae6))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant